Robust non-parametric regression via incoherent subspace projections
نویسندگان
چکیده
This paper establishes the algorithmic principle of alternating projections onto incoherent low-rank subspaces (APIS) as a unifying for designing robust regression algorithms that offer consistent model recovery even when significant fraction training points are corrupted by an adaptive adversary. APIS offers first algorithm non-parametric (kernel) with explicit breakdown point works general PSD kernels under minimal assumptions. also offers, straightforward corollaries, much wider variety well-studied settings, including linear regression, sparse recovery, and Fourier transforms. Algorithms offered enjoy formal guarantees frequently sharper than (especially in settings) or competitive to existing results these settings. They implement outperform several experimental
منابع مشابه
Robust Subspace Clustering via Thresholding Ridge Regression
In this material, we provide the theoretical analyses to show that the trivial coefficients always correspond to the codes over errors. Lemmas 1–3 show that our errors-removing strategy will perform well when the lp-norm is enforced over the representation, where p = {1, 2,∞}. Let x 6= 0 be a data point in the union of subspaces SD that is spanned by D = [Dx D−x], where Dx and D−x consist of th...
متن کاملRobust and Efficient Subspace Segmentation via Least Squares Regression
This paper studies the subspace segmentation problem which aims to segment data drawn from a union of multiple linear subspaces. Recent works by using sparse representation, low rank representation and their extensions attract much attention. If the subspaces from which the data drawn are independent or orthogonal, they are able to obtain a block diagonal affinity matrix, which usually leads to...
متن کاملRegression Modeling for Spherical Data via Non-parametric and Least Square Methods
Introduction Statistical analysis of the data on the Earth's surface was a favorite subject among many researchers. Such data can be related to animal's migration from a region to another position. Then, statistical modeling of their paths helps biological researchers to predict their movements and estimate the areas that are most likely to constitute the presence of the animals. From a geome...
متن کاملOnline Non-Parametric Regression
We establish optimal rates for online regression for arbitrary classes of regression functions in terms of thesequential entropy introduced in [14]. The optimal rates are shown to exhibit a phase transition analogous to thei.i.d./statistical learning case, studied in [16]. In the frequently encountered situation when sequential entropyand i.i.d. empirical entropy match, our resu...
متن کاملFast and Robust Subspace Clustering Using Random Projections
Over the past several decades, subspace clustering has been receiving increasing interest and continuous progress. However, due to the lack of scalability and/or robustness, existing methods still have difficulty in dealing with the data that possesses simultaneously three characteristics: high-dimensional, massive and grossly corrupted. To tackle the scalability and robustness issues simultane...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Machine Learning
سال: 2021
ISSN: ['0885-6125', '1573-0565']
DOI: https://doi.org/10.1007/s10994-021-06045-z